Learning Data-Driven Propagation Mechanism for Graph Neural Network
نویسندگان
چکیده
A graph is a relational data structure suitable for representing non-Euclidean structured data. In recent years, neural networks (GNN) and their subsequent variants, which utilize deep to complete analysis representation, have shown excellent performance in various application fields. However, the propagation mechanism of existing methods relies on hand-designed GNN layer connection architecture, prone information redundancy over-smoothing problems. To alleviate this problem, we propose data-driven adaptively propagate between layers. Specifically, construct bi-level optimization objective use gradient descent algorithm learn forward improves efficiency learning different combinations multilayer networks. The experimental results model seven benchmark datasets demonstrate effectiveness proposed method. Furthermore, combining with models, such as Graph Attention Networks, can consistently improve these models.
منابع مشابه
Visualization of Learning Processes for Back Propagation Neural Network Clustering
Method for visualization of learning processes for back propagation neural network is proposed. The proposed method allows monitor spatial correlations among the nodes as an image and also check a convergence status. The proposed method is attempted to monitor the correlation and check the status for spatially correlated satellite imagery data of AVHRR derived sea surface temperature data. It i...
متن کاملPerformance of Affordable Neural Network for Back Propagation Learning
Cell assembly is one of explanations of information processing in the brain, in which an information is represented by a firing space pattern of a group of plural neurons. On the other hand, effectiveness of neural network has been confirmed in pattern recognition, system control, signal processing, and so on, since the back propagation learning was proposed. In this study, we propose a new net...
متن کاملLearning Graph While Training: An Evolving Graph Convolutional Neural Network
Convolution Neural Networks on Graphs are important generalization and extension of classical CNNs. While previous works generally assumed that the graph structures of samples are regular with unified dimensions, in many applications, they are highly diverse or even not well defined. Under some circumstances, e.g. chemical molecular data, clustering or coarsening for simplifying the graphs is h...
متن کاملAttention-based Graph Neural Network for Semi-supervised Learning
Recently popularized graph neural networks achieve the state-of-the-art accuracy on a number of standard benchmark datasets for graph-based semi-supervised learning, improving significantly over existing approaches. These architectures alternate between a propagation layer that aggregates the hidden states of the local neighborhood and a fully-connected layer. Perhaps surprisingly, we show that...
متن کاملbreathomics for gastric cancer classification using back-propagation neural network
breathomics is the metabolomics study of exhaled air. it is a powerful emerging metabolomics research field that mainly focuses onhealth-related volatile organic compounds (vocs). since the quantity of these compounds varies with health status, breathomics assuresto deliver noninvasive diagnostic tools. thus, the main aim of breathomics is to discover patterns of vocs related to abnormal metabo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2022
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics12010046